Papers with document image understanding tasks
MGDoc: Pre-training with Multi-granular Hierarchy for Document Image Understanding (2022.emnlp-main)
Copied to clipboard
Zilong Wang, Jiuxiang Gu, Chris Tensmeyer, Nikolaos Barmpalios, Ani Nenkova, Tong Sun, Jingbo Shang, Vlad Morariu
| Challenge: | Existing methods learn features from word-level or region-level but fail to consider both simultaneously. |
| Approach: | They propose a multi-modal multi-granular pre-training framework that encodes page-level, region-level and word-level information at the same time. |
| Outcome: | The proposed model learns features from word-level and region-level but fails to consider both simultaneously. |